Papers with representation method
Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing research treats Chinese character as a minimum unit for representation . however, such representation suffers from two bottlenecks: 1) learning bottleneck; 2) parameter bottleneck, each individual character has to be represented by a unique vector. |
| Approach: | They propose a representation method for Chinese characters to break the representation bottlenecks . they map each stroke to a specific Latin character, thus allowing similar Chinese characters . |
| Outcome: | The proposed representation method breaks two representation bottlenecks in Chinese character representation . it maps each stroke to a specific Latin character, thus allowing similar Chinese characters to have similar representations . |
TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecasting (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods focus on reasoning at past timestamps to complete the missing facts, and there are only a few works of reasoning on known TKGs to forecast future facts. |
| Approach: | They propose a time-shaped reward method that captures historical knowledge graph snapshots and a new representation method for unseen entities to improve the inductive inference ability of the model. |
| Outcome: | The proposed method improves on four benchmark datasets with higher explainability, less calculation, and fewer parameters when compared with existing state-of-the-art methods. |